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WHAT IS CIAIMED: 

1. A method of monitoring performance of an 
interactive voice response (IVR) system used by an automated 
call processing center, a call from a caller to the call 
processing centering including an initial IVR portion of the 
call, and, at the caller's option, an agent-caller dialog 
portion of the call, said method comprising: 

generating logs of call activity within the IVR 
system for a plurality of calls; 

determining, from the logs of call activity, 
routing information related to the plurality of calls within 
the IVR system, including routing of calls out of the IVR 
system to an agent; 

noting, in the logs of call activity, predetermined 
significant activity in agent-caller dialog portions of calls 
routed to an agent; 

determining at least one quantity correlated to a 
true intention of callers utilizing the IVR system; 

generating a performance model of the IVR system 
from the logs of call activity; and 

analyzing the logs of call activity, the determined 
routing information, the at least one determined quantity 
correlated to the true intention of the callers, and the 
performance model to determine a performance value of the IVR 
system, wherein the performance value is used to monitor the 
IVR system. 

2. A method according to Claim 1, wherein said 
step of determining at least one quantity includes asking a 
caller about his/her true intention for calling the call 
processing center. 
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3. A method according to Claim 1, wherein said 
step of determining includes obtaining information from an 
agent to determine a true intention of a caller. 

4. A method according to Claim 1, wherein said 
method is performed on an ongoing basis. 

5. A method according to Claim 1, wherein the at 
least one determined quantity correlates to a routing 
accuracy of the IVR system. 

6. A method according to Claim 1, further 
comprising the step of generating an alarm when the 
performance value of the IVR system is determined to be below 
a predetermined value. 

7. An apparatus for monitoring performance of an 
interactive voice response (IVR) system used by an automated 
call processing center, a call from a caller to the call 
processing centering including an initial IVR portion of the 
call, and, at the caller's option, an agent-caller dialog 
portion of the call, said apparatus comprising: 

means for generating logs of call activity within 
the IVR system for a plurality of calls; 

means for determining, from the logs of call 
activity, routing information related to the plurality of 
calls within the IVR system, including routing of calls out 
of the IVR system to an agent; 

means for noting, in the logs of call activity, 
predetermined significant activity in agent-caller dialog 
portions of calls routed to an agent; 
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means for determining at least one quantity 
correlated to a true intention of callers utilizing the IVR 
systems- 
means for generating a performance model of the IVR 
system from the logs of call activity; and 

means for analyzing the logs of call activity, the 
determined routing information, the at least one determined 
quantity correlated to the true intention of the callers, and 
the performance model to determine a performance value of the 
IVR system, wherein the perfoinnance value is used to monitor 
the IVR system. 

8. An apparatus according to Claim 7, wherein said 
means for determining at least one quantity asks a caller 
about his/her true intention for calling the call processing 
center. 

9. An apparatus according to Claim 1, wherein said 
means for determining at least one quantity obtains 
information from an agent to determine a true intention of a 
caller. 

10. An apparatus according to Claim 7, wherein 
said apparatus operates on an ongoing basis. 

11. An apparatus according to Claim 7, wherein the 
at least one measured quantity correlates to a routing 
accuracy of the IVR system. 

12. An apparatus according to Claim 1, further 
comprising means for generating an alarm when the performance 
value of the IVR system is determined to be below a 
predetermined value. 
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13. An apparatus for monitoring performance of an 
interactive voice response (IVR) system used by an automated 
call processing center, a call from a caller to the call 
processing centering including an initial IVR portion of the 
call, and, at the caller's option, an agent-caller dialog 
portion of the call, said apparatus comprising: 

a log generation unit adapted to generate logs of 
call activity within the IVR system for a plurality of calls; 

a routing information determination unit adapted to 
determine, from the logs of call activity, routing 
information related to the plurality of calls within the IVR 
system, including routing of calls out of the IVR system to 
an agent; 

a significant activity notation unit adapted to 
note, in the logs of call activity, predetermined significant 
activity in agent-caller dialog portions of calls routed to 
an agent ; 

a true-intention determination unit adapted to 
determine at least one quantity correlated to a true 
intention of callers utilizing the IVR system; 

a performance model generation unit adapted to 
generate a performance model of the IVR system from the logs 
of call activity; and 

an analysis unit adapted to analyze the logs of 
call activity, the determined routing information, the at 
least one determined quantity correlated to the true 
intention of the callers, and the performance model to 
determine a performance value of the IVR system, wherein the 
performance value is used to monitor the IVR system. 

14. A system for monitoring performance of an 
interactive voice response (IVR) system used by an automated 
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call processing center, a call from a caller to the call 
processing centering including an initial IVR portion of the 
call, and, at the caller's option, an agent-caller dialog 
portion of the call, said system being operable to: 

generate logs of call activity within the IVR 
system for a plurality of calls; 

determine, from the logs of call activity, routing 
information related to the plurality of calls within the IVR 
system, including routing of calls out of the IVR system to 
an agent; 

note, in the logs of call activity, predetermined 
significant activity in agent-caller dialog portions of calls 
routed to an agent; 

determine at least one quantity correlated to a 
true intention of callers utilizing the IVR system; 

generate a performance model of the IVR system from 
the logs of call activity; and 

analyze the logs of call activity, the determined 
routing information, the at least one quantity correlated to 
the true intention of the callers, and the performance model 
to determine a performance value of the IVR system, wherein 
the performance value is used to monitor the IVR system. 

15. A system according to Claim 14, wherein a true 
intention of a caller is determined by asking the caller of 
his/her reason for calling the call processing center. 

16. A system according to Claim 14, wherein a true 
intention of a caller is determined from information obtained 
from an agent. 

17. A system according to Claim 14, wherein said 
system operates on an ongoing basis. 
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18. A system according to Claim 14, wherein the at 
least one quantity correlate to a routing accuracy of the IVR 
system. 

19. A system according to Claim 14, wherein said 
system further operates to generate an alarm when the 
performance value of the IVR system is determined to be below 
a predetermined value. 

20. A computer program product embodying a program 
for implementing a method of monitoring performance of an 
interactive voice response (IVR) system used by an automated 
call processing center, a call from a caller to the call 
processing centering including an initial IVR portion of the 
call, and, at the caller's option, an agent-caller dialog 
portion of the call, said program product comprising: 

code for generating logs of call activity within 
the IVR system for a plurality of calls; 

code for determining, from the logs of call 
activity, routing information related to the plurality of 
calls within the IVR system, including routing of calls out 
of the IVR system to an agent; 

code for noting, in the logs of call activity, 
predetermined significant activity in agent-caller dialog 
portions of calls routed to an agent; 

code for determining at least one quantity 
correlated to a true intention of callers utilizing the IVR 
system; 

code for generating a performance model of the IVR 
system from the logs of call activity; and 

code for analyzing the logs of call activity, the 
determined routing infonnation, the at least one determined 
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quantity correlated to the true intention of the callers, and 
the performance model to determine a performance value of the 
IVR system, wherein the performance value is used to monitor 
the IVR system. 

21. A computer program product according to Claim 
20, wherein a true intention of a caller is determined by 
asking the caller of his/her reason for calling the call 
processing center. 

22. A computer program product according to Claim 
20, wherein a true intention of a caller is determined from 
information obtained from an agent . 

23. A computer program product according to Claim 
20, wherein the method is performed on an ongoing basis, 

24. A computer program product according to Claim 
20, wherein the at least one determined quantity correlates 
to a routing accuracy of the IVR system. 

25. A computer program product according to Claim 
20, further comprising code for generating an alarm when the 
performance value of the IVR system is determined to be below 
a predetermined value. 

26. A method of monitoring performance of an 
automated response system used by an automated contact 
processing center, a contact from a contactor to the contact 
processing centering including an initial automated portion 
of the contact, and, at the contactor's option, an agent- 
contactor dialog portion of the contact, said method 
comprising: 
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generating logs of contact activity within the 
automated response system for a plurality of contacts; 

determining, from the logs of contact activity, 
routing information related to the plurality of contacts 
within the automated response system, including routing of 
contacts out of the automated response system to an agent; 

noting, in the logs of contact activity, 
predetermined significant activity in agent-contactor dialog 
portions of contacts routed to an agent; 

determining at least one quantity correlated to a 
true intention of contactors utilizing the automated response 
system; 

generating a performance model of the automated 
response system from the logs of contact activity; and 

analyzing the logs of contact activity, the 
determined routing information, the at least one determined 
quantity correlated to the true intention of the contactors, 
and the performance model to determine a performance value of 
the automated response system, wherein the performance value 
is used to monitor the automated response system. 

27. An apparatus for monitoring performance of an 
automated response system used by an automated contact 
processing center, a contact from a contactor to the contact 
processing centering including an initial automated portion 
of the contact, and, at the contactor's option, an agent- 
contactor dialog portion of the contact, said apparatus 
comprising: 

means for generating logs of contact activity 
within the automated response system for a plurality of 
contacts; 

means for determining, from the logs of contact 
activity, routing information related to the plurality of 
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contacts within the automated response system, including 
routing of contacts out of the automated response system to 
an agent; 

means for noting, in the logs of contact activity, 
predetermined significant activity in agent-contactor dialog 
portions of contacts routed to an agent; 

means for determining at least one quantity 
correlated to a true intention of contactors utilizing the 
automated response system; 

means for generating a performance model of the 
automated response system from the logs of contact activity; 
and 

means for analyzing the logs of contact activity, 
the determined routing information, the at least one 
determined quantity correlated to the true intention of the 
contactors, and the performance model to determine a 
performance value of the automated response system, wherein 
the performance value is used to monitor the automated 
response system. 

28. An apparatus for monitoring performance of an 
automated response system used by an automated contact 
processing center, a contact from a contactor to the contact 
processing centering including an initial automated portion 
of the contact, and, at the contactor's option, an agent- 
contactor dialog portion of the contact, said apparatus 
comprising: 

a log generation unit adapted to generate logs of 
contact activity within the automated response system for a 
plurality of contacts; 

a routing information determination unit adapted to 
determine, from the logs of contact activity, routing 
infoinmtion related to the plurality of contacts within the 
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automated response system, including routing of contacts out 
of the automated response system to an agent; 

a significant activity notation unit adapted to 
note, in the logs of contact activity, predetermined 
significant activity in agent-contactor dialog portions of 
contacts routed to an agent; 

a true-intention determination unit adapted to 
determine at least one quantity correlated to a true 
intention of contactors utilizing the automated response 
system; 

a performance model generation unit adapted to 
generate a performance model of the automated response system 
from the logs of contact activity; and 

an analysis unit adapted to analyze the logs of 
contact activity, the determined routing information, the at 
least one determined quantity correlated to the true 
intention of the contactors, and the performance model to 
determine a performance value of the automated response 
system, wherein the performance value is used to monitor the 
automated response system, 

29. A system for monitoring performance of an 
automated response system used by an automated response 
processing center, a contact from a contactor to the contact 
processing centering including an initial automated portion 
of the contact, and, at the contactor's option, an agent- 
contactor dialog portion of the contact, said system being 
operable to: 

generate logs of contact activity within the 
automated response system for a plurality of contacts; 

determine, from the logs of contact activity, 
routing information related to the plurality of contacts 
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within the automated response system, including routing of 
contacts out of the automated response system to an agent; 

note, in the logs of contact activity, 
predeteinnined significant activity in agent-contactor dialog 
portions of contacts routed to an agent; 

deteionine at least one quantity correlated to a 
tme intention of contactors utilizing the automated response 
system; 

generate a performance model of the automated 
response system from the logs of contact activity; and 

analyze the logs of contact activity, the 
determined routing information, the at least one quantity 
correlated to the true intention of the contactors, and the 
performance model to determine a performance value of the 
automated response system, wherein the performance value is 
used to monitor the automated response system, 

30. A computer program product embodying a program 
for implementing a method of monitoring performance of an 
automated response system used by an automated contact 
processing center, a contact from a contactor to the contact 
processing centering including an initial automated portion 
of the contact, and, at the contactor's option, an agent- 
contactor dialog portion of the contact, said program product 
comprising: 

code for generating logs of contact activity within 
the automated response system for a plurality of contacts; 

code for determining, from the logs of contact 
activity, routing information related to the plurality of 
contacts within the automated response system, including 
routing of contacts out of the automated response system to 
an agent; 



107 



EXPRESS MAIL NO. EL029404307US PATENT 

Attorney Docket No. 01-4007 

code for noting, in the logs of contact activity, 

predetermined significant activity in agent-contactor dialog 

portions of contacts routed to an agents- 
code for determining at least one quantity 

correlated to a true intention of contactors utilizing the 

automated response systems- 
code for generating a performance model of the 

automated response system from the logs of contact activity; 

and 

code for analyzing the logs of contact activity, 
the determined routing information, the at least one 
determined quantity correlated to the true intention of the 
contactors, and the performance model to determine a 
performance value of the automated response system, wherein 
the performance value is used to monitor the automated 
response system. 
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